Inside Out background image
From Screen To Heart
How do emotions shape the cinematic landscape?
A project emotionally created by the Team SPARKling
Sofia Tahouid • Matthias Wyss • Lina Sadgal • Yasmine Tilgui • Guillaume Vitalis

Introduction

        Cinema is more than entertainment, it’s an emotional symphony that grips the soul, stirs the heart, and leaves a mark long after the screen fades to black or the popcorn runs out. It’s Joy that makes us laugh, Fear that keeps us on edge, and Sadness that moves us to tears. But why do certain films resonate so deeply? How do they manage to make us feel as though they were crafted just for us? This emotional power is no accident my friend, it’s the result of a masterful design. Behind every unforgettable moment lies a deliberate strategy, where the film industry transforms emotions into tools to shape genres, guide storytelling, and create experiences that resonate strongly with audience expectations.

This leads us to an essential question: how does the big screen industry leverage emotions to shape the cinematic landscape and redefine the audience experience?

To crack this mystery, we’re heading straight into the Emotion Lab. And guess what? We’ve got the best experts on the job. Who better to call on than the ultimate dream team : Joy, Sadness, Fear, Anger, Disgust, and, of course, the mADAjestic Surprise. These Inside Out insiders are ready to lead the charge, running experiments, designing emotional blueprints, and uncovering how cinema pulls the strings of our hearts. So grab your popcorn (and maybe a tissue), and let’s see how emotions turn the magic of the silver screen into something unique.

Our experts

Let’s dive deeper into our brain

What resources do we have at our disposal?

Inside Out Brain

The foundation of our analysis is the CMU Movies dataset, which provides valuable information, including countries, genres, release years, and actors. Additionally, we enriched the dataset by obtaining :
    - IMDb ratings from IMDb's official website
    - IMDb reviews from IMDb’s official website
    - Release year from Wikidata
    - Release month from Wikidata
The processed final dataset comprises 11,564 movies and a total of 449,824 reviews ensuring a comprehensive and robust basis for analysis.

Naturally, the most important aspect of our dataset is the emotional part. The model we use for the emotion calculations is the Emotion English DistilRoberta model from HuggingFace. It extracts the following emotions : anger, disgust, fear, joy, neutral, sadness, and surprise from a text input.

We could not have conducted our experiments without the help of some remarkable mathematical tools! Techniques such as Pearson Correlation, Spearman Correlation, Principal Component Analysis (PCA), and K-Means Clustering played a crucial role in shaping our analyses. Let us introduce them properly:

Pearson Correlation
Spearman Correlation
PCA
KMeans
 Fear and Joy Dialogue

What is our DistilRoberta model capable of?

The text below is the Inside Out movie plot. Each sentence is highlighted in the color of the emotion that has been classified with the highest score by our model. The sentences that are assigned no color have been classified as neutral, which means that it doesn’t have a predominant emotion.

In the mind of a young girl named Riley Andersen are five personified emotions that influence her actions: Joy, Sadness, Fear, Disgust, and Anger. Riley's experiences become memories that are stored as colored orbs and are sent into long-term memory each night. The aspects of the five most important 'core memories' within her personality take the form of five floating islands. Joy acts as the leader and tries to limit Sadness's influence, perceiving her as an unnecessary burden for Riley. At age 11, Riley moves from Minnesota to San Francisco for her father's new job. On Riley's first day at her new school, Sadness retroactively saddens joyous memories, causing Riley to cry in front of her class. This creates Riley's first sad core memory. Joy tries to dispose of the memory using a pneumatic tube but knocks loose the other core memories during a struggle with Sadness, disabling the personality islands. Joy, Sadness, and the core memories are sucked out of Headquarters. In the absence of Joy and Sadness, Anger, Fear, and Disgust try to make happy core memories, but the results are disastrous, distancing Riley from her parents, peers, and hobbies. Without the core memories, Anger causes Riley's personality islands to crumble and fall into the 'Memory Dump', where things fade to non-existence as they are forgotten. While navigating the vast long-term memory area, Joy and Sadness encounter Bing Bong, Riley's imaginary friend, who suggests riding the 'train of thought' back to Headquarters. Meanwhile, Anger, intending to restore Riley's happiness, convinces Disgust and Fear that Riley should run away to Minnesota, where her happy memories were formed. Joy, Sadness, and Bing Bong catch the train, but it is derailed when another island collapses. Joy, who is afraid all of the core memories will become sad, abandons Sadness and tries to ride a 'recall tube' back to Headquarters. The ground below the tube collapses, sending Joy and Bing Bong plunging into the Memory Dump. Joy discovers a sad memory of losing a hockey game that turned happy when Riley's parents and friends comforted her, and she realizes Sadness's purpose in alerting others when Riley is emotionally overwhelmed and needs help. Joy and Bing Bong try to use his song-fueled wagon rocket to escape the Memory Dump but are unable to ascend due to their combined weight. Bing Bong jumps out of the wagon to save Joy and fades away in the Memory Dump, forgotten. Anger's idea disables the console, putting Riley into depression as she boards a bus to Minnesota. Joy reunites with Sadness, and they return to Headquarters. Riley's emotions admire her new personality islands, powered by core memories that contain a mixture of emotions, and are given an expanded console that has enough room for them to work as a team. Although they admit slight concern over a large red alarm marked 'puberty,' they forget about it.

And if you want to know how our model define each emotion based on the movie’s plots, let’s take a look at these spectacular wordclouds that beautifully align with our experts shapes:

This is a placeholder description. When you select an emotion, a corresponding explanation will appear here.

How are our movies classified?

Intuitively, we would all think that movie emotions are closely tied to the film's genre. So, we’d like to see how emotions are conveyed based on genres. Let’s first take a look at how many genres we have at our disposal!

Surprise saying that a lot of genres

Surprise is right, to simplify this complex view, we grouped genres into broader categories, making trends easier to study and interpret.

Joy saying that's much better

You're probably wondering why our experts rushed to analyze genres when our main focus is emotions. Well, let me tell you, we've followed ADA’s lectures, and now it's time to show you how to confirm the correlation between genres and emotions.

Correlation between genres and emotions

This heatmap reveals how each emotion naturally aligns with specific film genres based on the narratives present in the plots.

Joy illuminates comedy, romance, and musicals, genres crafted to bring smiles and inspire dreams. However, in horror, thrillers, and crime genres, it disappears entirely, overshadowed by darker emotions. Fear reigns supreme in horror, thrillers, action, and science fiction, dominating suspenseful and adrenaline packed stories. Yet, in musicals and romance, it is notably absent, panic is hard to evoke in the middle of a graceful choreography or during a candlelit dinner. Anger fuels action and crime, bringing energy and intensity to explosive narratives. Sadness thrives in dramas and historical films, where tears flow and sacrifices mark the spirits. Disgust, true to its nature, excels in horror and experimental films, unsettling audiences with uncomfortable scenes. Finally, Surprise shines in science fiction and adventure but occasionally appears unexpectedly in teen or comedy genres, adding captivating twists. But what about drama, war and history genres? Not enough room for his big “ta-da!”, she prefers to steal the show elsewhere.

Each emotion instinctively knows where it can shine, and where it must fade, orchestrating the cinema to illuminate the greatest scenes.

Additionally, the p-values confirm that the strong, positive, or negative correlations observed in the heatmap are not merely intuitive but statistically significant. They also reveal non existent emotion-genre relationships (p ≥ 0.05, near-zero correlations), showing that some emotions remain foreign to specific genres, although less pronounced than if the correlation were negative.

For instance, experimental and teen genres show no correlation with fear. After all, who would expect terror in enigmatic works or in an adolescent story centered on daily concerns? Science fiction, on the other hand, has nothing to do with anger, preferring to marvel at distant and futuristic galaxies or utopias. Historical films lack both disgust and anger, while animated and adventure genres show an unexpected absence of joy. These absences were expected, as these emotions are often felt by viewers but rarely explicitly expressed in film plots. But what stands out most in this heatmap are the war and propaganda columns. The propaganda genre has only a very weak but significant link with disgust, reflecting its informative and manipulative intent rather than emotional engagement. War, on the other hand, shows no correlation with sadness, anger, or disgust, instead favoring fear and surprise to convey the intensity of conflicts, even though the absent emotions are widely recognized as ones deeply felt by audiences when watching this type of film. This suggests that the emotions audiences commonly associate with certain genres are not always directly conveyed through the plots or film narratives but instead emerge from how viewers perceive and interpret the stories thanks to the filmmaker jobs.

Emotion distribution of movie plots across genres

Alright, now that we are sure the we have a rock-solid foundation for our analysis, it’s time we dived into the fun part : exploring how emotions are sprinkled across different genres. Let’s see where joy, fear, and all their buddies decide to hang out!

These plots give us the overall distribution of emotions across genres, let’s take a deeper dive into how specific emotions vary within movie plots and reviews. By breaking down each emotion, we can uncover fascinating trends and nuances - like how joy, sadness, or fear are represented differently in the storytelling versus audience perception.

Click on your favorite emotion! You will see the scores of this emotion in movie's plots and reviews by genres, with a little explanation.

This is a placeholder description for both graphs. When you select an emotion, corresponding explanations for both graphs will appear here. The first graph illustrates the distribution of the emotion across various movie genres, and the second graph offers a complementary view. Both graphs highlight different aspects of how the selected emotion is portrayed in films and across genres.

Emotion transitions throughout movies

Now that we’ve explored how emotions are distributed across different genres, why not dive deeper into our analysis. Have you ever felt, while watching a movie, that every genre seems to follow its own pre-defined emotional flow? Oh, those filmmakers, always trying to toy with our emotions, right?

As long as we’re still in the lab, let’s let our expert team take over. Who better than Joy, Sadness, and the rest of the gang to break down these transitions and reveal the emotional blueprints that guide us through every movie? And it’s simple! Our experts divided each film into three parts:

Ready to share their findings, our expert team rolled out the projector and proudly displayed the results. So, let’s uncover the emotional journey scene by scene and see what they’ve found!

Heatmap

Disgust saying: 'Yay! The only color that oes not digust me!'

You’re probably asking yourself what it is, and we’re here to elucidate the mystery. This is a heatmap. Each line corresponds to the probability distribution of the transitions from an emotion. So each entry of line emotion_i and column emotion_j corresponds to the probability of transitioning to emotion_j knowing that we are in emotion_i. As we can see in the legend, the darker the color is, the higher the probability.

Let’s take some genres examples and see what this weird green square tells us :

Select a category to see the description.

Sankey Diagram

Let’s now take a closer look at how emotions transition within the films themselves. We have a stunning Sankey chart, full of vibrant colors!

[Surprise : “Wow! A lot of colors! It’s beautiful but can you explain in details what is this?”]

This analysis reveals how the film industry not only uses emotions to tell stories but also to shape and define genres themselves. Each genre is uniquely distinguished, not just by its overall emotional tone, but by the transitions that weave one feeling into another. From the interplay of joy and sadness in romances to the dominance of fear and surprise in war films, these patterns highlight how emotions give genres their unique identity. Rather than serving as a mere backdrop to the narrative, emotions are wielded as a defining force, shaping genres into powerful tools that influence how we connect with films.

Moreover, the behavior of emotions within genres closely mirrors real life, which these genres are meant to illustrate. Whether it’s the comfort of joy in comedies, the suspenseful fear of thrillers, or the bittersweet sadness of dramas, these emotional dynamics reflect the complexities of human experience. This purposeful orchestration ensures that every genre offers its own distinct emotional rhythm, not only captivating audiences but also resonating with the realities they live, leaving them immersed in unforgettable cinematic experiences.

Select a category to see the description.

Emotion evolution and variations throughout a movie

What if we dive deeper into variations of emotions ? Not only their distributions. It could be interesting to see how each emotion proportion increases or decreases throughout a movie, and which ones vary the most. We used two types of plots : a barplot and a scatter plot. The bar plot gives the emotion distribution of each time slot whereas the scatter plot translates the emotion variations between the actual time slot and the previous one.

Let’s look closer at some genres.

Comedy movies are emotional rollercoasters in their own way. When we’re halfway through the movie, expecting more laughs, boom! Things take a turn. That cheerful vibe from the start? It takes a descent, dropping by 31.73%. And guess what jumps in to steal the spotlight? Anger, skyrocketing by a whopping 35.59%! It’s like the characters have landed in some massive argument or chaotic mess, and we’re caught up in the drama. Honestly, the middle of the movie feels more like a rollercoaster than a comedy. But then, the ending comes around, and everything shifts again. Joy makes the ultimate comeback, soaring with a crazy +48.45% boost. It’s like all the chaos from before melts away, and the movie finally delivers that feel-good, laugh-out-loud ending we’ve been waiting for. Anger, disgust, and fear all take a backseat, fading into the background, while sadness and surprise chill out, letting joy take the spotlight. :D

Emotion trends over year periods

We’ve spent some time diving into the details and exploring how emotions flow within films, but what if we zoom out for a broader view? Have you ever noticed how every time of year comes with its own emotional vibe? Fear takes over during Halloween, joy sparkles at Christmas, and heartbreak might just steal the show on Valentine’s Day. But do you think the film industry taps into these seasonal moods as part of a calculated marketing strategy? Let’s go back into the Emotion Lab and see how the calendar shapes the emotional journeys we experience on the big screen!"

The month-by-month variation in plot emotions tells a fascinating story about how sentiments evolve with the year periods. Each trend seems indeed synchronized with key moments of the year, reflecting a close link between the film industry and the emotions highlighted during the year in our real life.

These trends clearly show how the film industry adjusts its stories to the different times of year. Each variation is not insignificant: it echoes the moments shared by audiences at different times of the year, confirming that cinema is an emotional mirror, perfectly tuned for each season.

Anger

As Anger sat around twiddling his thumbs, feeling a bit useless in the lab’s experiments, he decided to dust off the old chemistry books lying around. Flipping through the pages, an idea struck him, why not add reviews into the mix of ingredients? Comparing the emotional trends between plots and reviews could uncover some fascinating parallels or surprising gaps. So, with a spark of purpose, Anger jumped back into action to see what this new experiment could reveal!

In the reviews, joy explodes over the New Year period, followed by the rise of Disgust in February, mirroring the emotions of the plots. In March, there’s a noticeable rise in joy, linked to the arrival of spring, but from here the differences with the plots then widen. During the blockbusters of June and July, joy remains dominant, unlike the plots where more varied emotions take over. Sadness makes its appearance in August and September, probably influenced by the end of summer and the return to routine, while in October, Surprise gains ground with Halloween, as in the plots. At Thanksgiving, Sadness and Surprise mix, before Joy triumphs in December, driven by the festive spirit.

These divergences show that viewers are more likely to express their overall feelings, influenced by the season, the general atmosphere of the movie and the overall cinematic experience, rather than by the intrinsic and complex emotions of the stories.

This graph emphasizes the differences in period-to-period emotional trends between plots and reviews throughout the year. Among all analyzed emotions, only Disgust shows a significant correlation (p = 0.020), indicating consistency between the two sources for this specific emotion. The lack of significance for other emotions reflects divergences in how viewers perceive emotions compared to those expressed in film narratives over the months.

Time for holidays!

Emotions in a plane

You know what could be even more sensational than travelling through time? Taking a trip through time all over the world! For this, our experts mapped each movie to the countries they were released in as well as to its decade and calculated the most dominant emotion grouping by decade and country. So join me for this wonderful adventure!

Emotion map of movie plots

On the following graph, we can explore the most dominant emotion in movie plots across decades and countries.

Ohhh! It looks like the world has been screaming anger, sadness, and disgust…

The United States of America, for instance, starts by having mostly sad movies released until 1950, then it enters into a big spiral of anger.

Even Finland, the world’s happiest country, seems to be stuck between sadness and disgust and only displays joy once.
While hovering over different countries, we observe that Joy and Surprise rarely appear in the map and almost systematically are the last emotion scores for countries. If we make a little historical parallel, we can think of the 20th century as the century of the two world wars, so perhaps this is why violent or sad movies are the ones that have emerged the most. So another time, filmmakers of the time may have leaned into these themes to reflect the collective trauma and struggles, using cinema as both a mirror of harsh reality and a tool to forever etch these defining events into memory. They don’t just reflect the trends of the moment month-by-month, but adapt their stories, themes, and above all, the overarching emotions to translate the upheavals of the times and the defining events of each decade.

Joy is sad

But does this mean that the perception of the world is also as gloomy and pessimistic for the reviewers of these movies?
Let’s find out!

Emotion map of reviews

This time, we’ll map the most dominant emotion of the reviews across decades and countries.

Are you ready for this new adventure? Let’s go!

Joy thoughtful

Ah! That’s way better. Look at this beautiful gold color!

We can clearly see that it’s not because a country is more represented by angry, sad, scary, or disgusted movies that the watcher considers it this way.

What does this tell us about the average rating of these movies per country? Is it because the most dominant emotion is joy that the average rating for countries will be high all over the world too? Let’s investigate!

Notice that the bubble’s size is correlated to the number of movies released in the country.

Interestingly, the trend in average ratings seems to generally follow the wave of joy's dominance in reviews across all these countries, suggesting that experiencing this emotion after watching a film significantly influences how positively audiences evaluate it.

But despite this overall trend, there are some notable exceptions like Zambia and Zimbabwe in which the movies are rated poorly but still show joy as the dominant emotion in reviews. This might be due to the lack of advanced cinematic infrastructure or resources in these regions, making it challenging to fully entertain and satisfy the audience.

Ratings per emotion

Let’s analyze this deeper by plotting statistics on the ratings per dominant emotion across all movies.

- Joy comes first when it comes to high ratings, with a median close to 10, although it has some low-rating outliers.

- Disgust, as expected, comes last with a median of 5 and a third quartile of 7.

This analysis highlights how promoted emotions influence movie ratings in unique ways. Joy, known for its universal appeal and uplifting effect, consistently resonates with audiences, leading to higher ratings overall. On the other hand, disgust, tied to discomfort and negative reactions, tends to result in lower ratings, reflecting its more repulsive nature. These findings emphasize the powerful role emotions play in shaping the audience's perception and evaluation of films.

Oh, and remember the emotion transition graph we looked at earlier? It showed how emotions evolve from the beginning to the middle and then to the end. Joy, while nearly absent in the middle, makes a non-negligible comeback in the final act, maybe another marketing strategy to ensure audiences leave the theater on a better feeling and thus let out a better rate.

Emotions per rating

And now let's analyze the other way around! On the following graphs we can explore the emotion distribution of movie's plots and reviews accross different average movie rating bins.

And now click on your favorite emotion! You will see more into details the best or the worst rate a film has if its plot or its reviews represent this emotion.

This is a placeholder description for both graphs. When you select an emotion, corresponding explanations for both graphs will appear here. The first graph illustrates the distribution of the emotion across various movie genres, and the second graph offers a complementary view. Both graphs highlight different aspects of how the selected emotion is portrayed in films and across genres.

Conclusion

We have shown how the movie industry masterfully leverages emotions, not only to tell stories but to define and reshape genres themselves. Each emotion, brought to life by our experts Joy, Sadness, Fear, Anger, Disgust and Surprise, plays a distinct role in crafting unforgettable cinematic experiences. Each genre finds its unique identity through a deliberate orchestration of emotions, whether the comforting joy of comedies, the gripping fear of thrillers or the poignant sadness of dramas. Joy lights up the screen in romances and musicals, Fear dominates the suspenseful twist of thrillers. Sadness quietly thrives in dramas, Anger fuels the energy and intensity of actions and crime narratives, Disgust unsettles viewers in experimental and horror movies and Surprise keeps audiences on the edge of their seats in science fiction and adventures. Our emotional experts weave intricate transitions, transforming genres into emotional symphonies that captivate audiences and resonate deeply with their personal experiences. It reveals how filmmakers strategically craft emotional journeys to leave lasting impressions on us. This design ensures that our experts not only enrich the storytelling, but also create some unforgettable cinematic experiences and leave audiences immersed in the magic of the silver screen!

Play time!

The core of our analysis may be wrapped up, but the fun is far from over! Think of this as the post-credits scene, a chance to explore some lighter, unexpected insights and entertaining discoveries. Sit back and enjoy as we dive into these bonus highlights and surprising experiments!

Shining the spotlight: Actors

Actors are the heart and soul of every movie. And yet, we haven’t talked about them. Let’s delve into our dataset and uncover what the profiles of these cinematic storytellers reveal. We used the Principal Component Analysis algorithm to display our actors according to the mean emotions of the movies they played in, computed on the plots and the reviews, respectively.

It is interesting to see that during the dimensionality reduction all the different emotions are somewhat clearly separated clusters except for the joy and sadness. It seems that the mean emotional profile type of actor with joy or sadness as dominant emotion is intertwined.

Wow! A slice of pizza! 😋 As we saw previously, joy is the most dominant emotion across all the reviews emotions. As we can see, this is also reflected here. This time, actors associated with anger and surprise are mixed with the others emotions. This can be explained by their number, which is unimportant compared to other emotions. The PCA algorithm then gives less importance to this particular axis for dimensionality reduction.

Actor emotional profile selector

Let's see in more details the emotional profiles of our main actors. We comprised, in the following plot, the top 100 actors in terms of the number of movies played in our data set.

So, now the question that you may have on your lips. Who are those that make us feel the most emotional?

Actor Name
Actor Image

Select a mode and an emotion to see the content.

Read more

Recommender System

0%
0%
0%
0%
0%
0%